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We investigate the degree of discontinuity of several solution concepts from 
non-cooperative game theory. While the consideration of Nash equilibria 
Q\ ' forms the core of our work, also pure and correlated equilibria are dealt 

with. Formally, we restrict the treatment to two player games, but results 
r__i . and proofs extend to the n-player case. As a side result, the degree of dis- 

| continuity of solving systems of linear inequalities is settled. 
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1. Introduction 

> 

■ Both for applications and theoretical considerations, the algorithmic task of computing 

t^J- ■ Nash equilibria from certain representations of games is of immense importance. A 

natural mathematical formulation of game theory uses the real numbers for payoffs 
and for mixed strategies, while classical models for algorithms require a restriction to 
countable sets. By imposing suitable restrictions and modifications to obtain countable 
| problems, the complexity of computing a Nash equilibrium for a normal form game was 

proven to be PPAD-complete ([1], [2]). 

Here we will use another approach: Instead of limiting the problem, we will extend 
the theory of computation. While the TTE- framework ([3]) is perfectly capable of for- 
mulating the task of computing Nash equilibria from normal form games, we will see 
that even the most trivial cases are discontinuous, and hence not computable. 

To gain a deeper understanding of the problem, its degree of discontinuity will be 
studied. Mirroring an approach in the study of game theory using classical computational 
complexity, we will also examine other solution concepts such as correlated equilibria. 
While correlated equilibria seem to be computationally easier than Nash equilibria 1 , 



X 

5-H 



1 In [4] several decision problems regarding Nash equilibria and correlated equilibria were compared, 
most of them turned out to be NP-hard for Nash equilibria and to be in P for correlated equilibria. 
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we will prove that both concepts share a degree of discontinuity. Limitation to pure 
strategies yields a strictly less discontinuous problem, the classical problem can be solved 
by a cubic algorithm 2 . 

2. Preliminaries 

2.1. Game Theory 

An n x m bi-matrix game is simply given by two n x m real valued matrices A and B. 
Two players simultaneously pick an index, row player chooses an i 6 {1,2, . . . ,n} and 
column player chooses an j € {1, 2, . . . ,m}. Row player gets A^ as a reward, column 
player gets Bij. We consider several solution concepts defined as equilibria, where no 
player has an incentive to change her strategy unilaterally. 

Definition 1. A pure equilibrium for a n x m bi-matrix game (A, B) is a pair £ 
{1, . . . , n} x {1, . . . , m} satisfying Aij > A^j for all k € {1, . . . , n} and Bij > Bn for all 
I G {l,...,m}. 

As pure equilibria do not exist for all games, a more general notion is introduced. If 
both players can randomize independently over their actions, one is led to the definition 
of an m-mixed strategy as an m-dimensional real valued vector s with non-negative 

m 

coefficients and ^ Sj = 1. The set of m-mixed strategies will be denoted by S m . 

Definition 2. A Nash equilibrium for an n x m bi-matrix game (A, B) is a pair (x, y) £ 
S n x S m satisfying x T Ay > x T Ay for all x € S n and x 7 By > x 1 By for all y 6 5 m . 

If is a Nash equilibrium, again neither of the players can improve her payoff 

by changing her mixed strategy unilaterally. A famous result by John Nash ([7]) es- 
tablished that Nash equilibria in bi-matrix games always exist. By identifying a pure 
strategy with the mixed strategy that puts weight 1 on it, pure equilibria can be con- 
sidered a special case of Nash equilibria. An even more general solution concept can be 
obtained by allowing the individual player's randomization processes to be correlated 
([8])- 

Definition 3. A correlated equilibrium for a n x m bi-matrix game is a real valued 

n m 

n x m matrix C with non-negative entries and ^ ^ C« = 1 so that 

i=lj=l 

m m 

AjjCjj > AijCjj 

3=1 3=1 



2 There are, however, several interesting hardness results for finding pure equilibria in games ([5], [6]), 
originating in other representations or requiring additional properties. 
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holds for all 



i,*e{i,2,... 



n} and 



n n 



i=l i=l 



holds for all j, k G {1, 2, . . . , to}. 

Given a Nash equilibrium (x,y), a correlated equilibrium can be constructed as = 
while each correlated equilibrium of this form can be obtained from a Nash equi- 
librium, allowing us to consider Nash equilibria as special cases of correlated equilibria. 
Thus, finding a correlated equilibrium has to be easier than finding a Nash equilibrium, 
as we just presented a reduction. 

Another way of creating an easier problem consists in a restriction of the games used. 
A zero-sum game is a bi-matrix game of the form (A, —A). 

2.2. Representing Games 

In order to consider games as inputs to Type-2-Machines, they have to be coded into 
infinite sequences. The choice of the countable alphabet used is irrelevant for the theory, 
to simplify proofs we will use either {0, 1} or N, depending on the context. The degrees of 
discontinuity we study are those of the realizations, that is of functions turning names of 
instances into names of solutions. Since all occurring representations will be admissible, 
topological properties carry over between sets of games and sets of names for games, etc. 

As games in normal form are pairs of real matrices, and (possible) equilibria pairs of 
real vectors (or again real matrices), one can quickly derive suitable representations by 
using product and coproduct representations ([3], [9]), starting from any representation 
of the real numbers. 

The standard representation p of the real numbers is chosen for various reasons; it is 
admissible and provides a convincing class of computable functions, in contrast to some 
of the alternatives ([3], [10]). Additionally, as demonstrated in [11], the representation p 
is equivalent to the representation naturally arising for the results of repeated physical 
measurements. For defining p, we fix a bijection v : N — ► Q with v(0) = 0, so that all 
the usual operations on Q are computable w.r.t. v. 

Definition 4. Let p(w) = x G E hold for w G N N , if \u(w(i)) — x\ < 2~ l holds for all 
i G N. 

Definition 5. Let wbea T-name for the bi-matrix game (A, B), if 

1. w = n l m 0t(;2, when (A, B) is an n x to game 

2. W2 = (w a ,w b ), where ( ) denotes the usual pairing function 
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5. piwfj) = Aj 

6. p(v^) = Bij 

Representations for pure, Nash and correlated equilibria can be derived in the same 
fashion. Detailed definitions are omitted here. 

2.3. Comparing Discontinuity 

As games can have multiple equilibria, we do not consider a function assigning an equi- 
librium to each game, but rather a multi- valued function. We will identify a multi- valued 
functions with the set of its choice functions. To compare the discontinuity of such sets, 
Type-2-Reducibility as studied in e.g. ([13], [14], [15], [16], [24], [17], [9]) is used, as well 
as the Level of a function (or a set of functions), introduced in [16]. 
We use the following definition of Type-2-Reducibility: 

Definition 6. Let A, B be multi-valued functions. Then A <i B holds, iff there are 
continuous partial functions F, G with w i— ► F(w,g(G(w))) £ A for each g £ B. 

As demonstrated in [9] (for suprema) and [12] (for infima), <2 induces a completely 
distributive complete lattice. We use [P^lneN to denote the supremum of a countable 
family (P n ) nG pj. This allows to consider the degree of discontinuity of finding equilibria 
in any game as the supremum of the degrees of discontinuity of finding equilibria in 
games with fixed size. 

As the Level will play only a minor role in our considerations, we refer to [9] for 
definitions. 

3. Single Player Games and Pure Equilibria 

From the perspective of game theory, single player games are trivial: The acting player 
chooses whatever action is best for her. As a discrete computation problem, this amounts 
to finding a maximum in a list of integers, a task that can be solved in linear time or 
logarithmic space. As the problem posed over the reals is discontinuous, we will study 
the problems lPuRE n and IPure of finding pure equilibria in single player games with 
n actions and without fixed game sizes. It shall be noted that single player games can 
be identified with nxl bi-matrix games, justifying their inclusion. 

As every n x 1 bi-matrix game has a pure equilibrium, and Cjj > can only hold in 
a correlated equilibrium C, if the entry An is maximal in A (and thus (i, 1) is a pure 
equilibrium), finding pure, Nash and correlated equilibria is equivalent for single player 
games, so the restriction to pure equilibria does not invoke any loss of generality. 

The degree of discontinuity of lPuRE n turns out to be equivalent to another family of 
problems, MLPO n , introduced in [13] as generalizations of the lesser limited principle 
of omniscience (LPO) studied in constructive mathematics ([18]). 

Definition 7. A function / : {( Pl , . . . ,p n ) 6 (N N ) n | 3i < n pt = N } ->■ {1, 2, . . . , n} is 
in MLPO n , if it fulfills Pf( Pl , P2 ,...,p n ) = N for all valid 
(pi,p 2 , -,Pn)- 
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Theorem 8. MLPO n = 2 lPURE n 

Proof. First, we present a reduction from MLPO n to 1Pure„. The n input bands for 
MLPO n can individually be translated to the n relevant input bands for lPuRE n . As 
long as is read, the rational number will be printed. If another number is read in 
the ith step for the first time, print the rational number —2 l+l from now on. All bands 
containing N will be translated to a p-name of 0, and all other bands to a p-name of a 
negative number, so a pure equilibrium corresponds to a 0-entry. 

For the other direction, all input values have to be compared. As long as no contra- 
diction for the assumption that the ith value is the largest one has been found, will be 
printed on the ith output tape. If contradiction is found, print 1. Then an output tape 
contains N , if the corresponding input tape contains a p-name of a maximal entry. □ 

In the next step, we extend the scope of consideration to finding pure equilibria in 
arbitrary bi-matrix games. The relevant problems are PuRE nm , where the size of the 
game is restricted to n x m, and the general case denoted by Pure. For obtaining results, 
reducibility to MLPO n shall be expressed by a partition property: 

Lemma 9. Let H be a multi-valued function defined on a strongly zero- 
dimensional metrisable space 3 X. Then H < 2 MLPO n holds, iff there are n closed 

n 

sets Ai, i < n with X = (J Ai, so that for each i < n, there is an /' G H so that f\, is 

i=l 

continuous. 

Proof. Assume H < 2 MLPO n , so there are continuous F, G with 
x i ► F(x, g(G(x))) G H for all g G MLPO n . Let the ith component of G be de- 
noted by Gi. Consider G t ~ 1 (0 N ). As Gi is continuous, this set is closed. There is 
a function g G MLPO n , so that for x G Gr 1 (0 N ), g{G{x)) = i holds. Thus, if 
x i — > F(x,g(G(x))) G H is restricted to G~ 1 (0 N ), it is equal toxn F(x,i), and therefore 

n 

it is continuous. As there is an i with Gi(x) = N for each x G X, X = [j G~ 1 (0 N ) 

i=l 

holds, completing the first part of the proof. 

For the other direction, note that for each closed subset A of a strongly zero-dimensional 
metrisable space X, there is a continuous function d A : X -> {0, 1} N with A = d~^({0 N }). 
Given sets Ai, i < n as specified above, consider the function D : X — > ({0, de- 
fined through D{x){i) = cIa^x). Further, define a continuous function F on the set 

n 

(J Ai x {i} through F(x,i) = /,% (x), where f % G H is a function that is continuous 

i=i 1 i 

when restricted to Ai. As H is a multi-valued function, x *— > F(x, g(D(x))) is in for 
each 5 G MLPO n . □ 

Theorem 10. PuRE nm < 2 MLPO n * m . 



3 Examples for such spaces are {0, 1} N and N N with their standard topologies. A brief characterization 
of strongly zero-dimensional metrisable spaces can be found in [9], for details we refer to [16] and 
[19]. 
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Proof. Given an n x m bi-matrix game (A,B), the condition for the pair to be a 
pure equilibrium is Aij > Akj and B- V j > Bu for all A: < n, Z < m. This implies that the 
set P%> m = {(A, B) | is an equilibrium of (A,B)} C M nm x M nm is closed. Due to 
the admissibility of T, the set of corresponding names for the games is also closed. As 
the set ofnxm bi-matrix games which have a pure strategy equilibrium is the union 
U Pnm, an application of Lemma 9 yields the claim. □ 

i<n,j<m 

Corollary 11. IPure = 2 PURE. 

Proof. As both problems are the respective limits, considering Theorems 8 and 10 is 
sufficient. □ 

The same reasoning used to establish the equivalence of finding pure strategies in 1 
player games and in 2 player games can directly be extended to any finite number of 
players. While Nash and correlated equilibria have the same degree of discontinuity as 
pure equilibria in single player games, we will continue to show that a higher degree of 
discontinuity emerges in the two player case. 

4. Nash and correlated equilibria in bi-matrix games 

We will now consider Nash and correlated equilibria in bi-matrix games. The problems 
CORR nm and NASH nm are the fixed size versions, Corr and Nash the general problems. 
An additional dimension of the problem is whether the games are zero-sum, yielding 
the problems ZCORR nm , ZNASH nm and the corresponding general problems. Straight- 
forward reasoning yields the reductions: 

ZCORR nm < 2 CORR nm < 2 NASH„ m ZCORR„ m < 2 ZNASH nm < 2 NASH nm 

4.1. The discontinuity of robust division 

Similar to MLPO n being representative of the kind of discontinuity we face when search- 
ing for pure equilibria, we will start with considering division, which will turn out to be 
typical for correlated and Nash equilibria. Computing | given two real numbers a, b ^ 
is continuous, of course. However, testing whether b ^ is not. A robust variant of 
division, which accepts division by zero and returns an arbitrary value, is not continuous 
anymore: 

Definition 12. Let rDiv be the set of functions d defined on 
{(u,v) \ < p(u) < p(v)} satisfying p(d(u,v)) = ^ for p(v) > 0. 

While Lev(RDiv) = 2 establishes robust division as an only slightly discontinuous 
problem, the following result shows that robust division introduces a new kind of dis- 
continuity not present in finding pure equilibria. 

Theorem 13. rDiv ^ 2 Pure. 
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Proof. We assume rDiv <2 IPure, due to Corollary 11. This implies the existence 
of continuous functions F, G, L so that for each E E IPure the function cIe defined 
through d E (u,v) = F(u, v, E(0 L ( u > v h01G(u,v))) is in rDiv. Informally, L chooses the 
size of the game, G gives the game and F uses a maximal value of the game to derive 
the result. 

We consider n = L(0 N ,0 N ). As L is continuous, the set L~ l ({n}) is open and closed, 
so it contains an open environment of (0 N , N ). Especially there is a k € N with fc N N x 
fc N N ^ L~ l {{n}). We note ^ = jjjS where = i/(u(t)) * 2-*- 1 and = 

v{v{i)) * 2 _fc_1 . Thus we obtain rDiv < 2 lPuRE n . 

According to Lemma 9, rDiv <2 1Pure„ implies the existence of n closed sets A{ so 
that for each i there is an /j £ rDiv so that ft restricted to Ai is continuous. If there is 
an I with (0 N ,0 N ) A h then there is a k G N with (0 fc N N x fe N N ) n A t = 0, so with a 
repetition of the argument used above we can conclude rDiv <2 lPuRE n _i. Thus we 
can assume (0 N , N ) € A\ for all Z < n. 

For I < n + 1 we define a sequence (w l k )keN of sequences through w l k (i) = for z < k 
and = (/2 fc )~ 1 for i > k. Furthermore, define the sequence (vk)keN of sequences 

through Wfe(i) = for i < k and ffc(i) = 2~ k for i > k. For each sequence (w^ffc) there 
must be an V so that Ay contains an infinite subsequence (w l k ,Vk) of (w l k ,Vf.). As there 
are n + 1 sequences and n sets, the pigeonhole principle ensures that there is a set Ai 
containing the sequences (w l k ,Vk) and (w l k ,Vk)- 

Now observe lim (w[},v k ) = lim (w l k 2 ,v k ) = (0 N ,0 N ), but f t (w l k \v k ) = l^ 1 + l 2 l = 

k— >oo k— >oo 

fi(w l k ,v k ). Thus, the restriction of /j to Aj is not continuous in (0 N ,0 N ), yielding a 
contradiction to the assumption. □ 

We will now use modifications of the game matching pennies as a gadget to implement 
divisions in a game. 

A=(°°A B = -A MP(a,b) = (A,B) 

If both a > and b > 0, the unique correlated equilibrium is obtained from the unique 
Nash equilibrium x = y = (^zj, ^tj)- If a = 0, 6 > 0, then is an equilibrium, iff 

y = (1, 0), and for a > 0, b = we have y = (0, 1). 

Theorem 14. rDiv < 2 ZCORR22 

Proof. Given a pair of p-names for real numbers a, b with < a < 6, a name for the 
game MP(a, b — a) can be computed. A correlated equilibrium C of MP(a, b — a) has 
the form: 

en C12 \ _ / xy x(l - y) 

C21 c 2 2 / I (l-x)y (l-x)(l-y) 



C 



Thus, one can obtain en + C21 = y = f for 6 > 0. □ 

Theorem 14 in conjunction with Theorem 13 implies ZCORR22 ^2 Pure, so even the 
simplest case of finding mixed strategies is not reducible to finding pure strategies. The 
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problem rDiv itself cannot capture the discontinuity of finding Nash equilibria, due to 
Lev(ZNASH22) = 4 (s. Subsection 5.2), compelling us to derive a sequence of problems 
with increasing level from rDiv. 



4.2. Products of Problems and Products of Games 

The product of functions can be considered as computing all of them in parallel. This will 
allow us to specify exactly the degree of discontinuity of problems solvable by multiple 
robust divisions, once we defined products for multi-valued functions. The following 
definitions and results on the products of multi-valued functions and their discontinuity 
extend corresponding results from [17]. 

Definition 15. For functions / : X -> Y, g : U -> V, define (f,g) : (X x U) -> (Y x V) 
through (f,g){x,u) = (f(x),g(u)). Define (f) 1 = / and (f) n +± = (/,(/}"). 

Definition 16. For relations P, Q, define (P,Q) = {(f,g) \ f £ P,g £ Q}. Define 
(P) = P and (P) n+1 = (P, (P) n ). 

\P, Q~\ <2 (P, Q) holds, but the converse is false in general. If / <2 g holds, then 
also (/, h) <2 {g,h). As ( ) is associative, it can be extended to any finite number of 
arguments in the standard way. There is a useful distributive law for [ ] and ( ) which 
we will state as (P, \Qi~\i e m) =2 \{P, Qi)]ieN- 

For games, our notion of a product will be inspired by the model of playing two 
independent games at once. This will allow us to establish a link between products 
of relations and products of games. We will use [ ] to denote a bijection between 
{1, 2, . . . , n} x {1, 2, . . . , m} and {1,2,..., ran) for suitable n, m. 

Definition 17. Given an rt\ x m\ bi-matrix game (A 1 ,!? 1 ) and an ri2 x TO2 bi-matrix 
game (A 2 , B 2 ), we define the (n\n2) x (m\m2) product game {A , B l ) x (A 2 , B 2 ) as (A, B) 
with A [il!i2]]juh] = A\ xh + A 2 2j2 and 

B [iiMViM = B hh +B lj 2 - 

The product of games nicely commutes with the notions from game theory used in 
this paper, as will be established by the following theorems. A slight exception holds 
for the zero-sum property: A zero-sum game can always be expressed as the product of 
two constant-sum games which are not zero-sum. However, as a constant-sum game can 
always be normalized to an equivalent zero-sum game, this is not problematic for our 
purposes. 

For simplifying notation, in the following theorems and their proofs, (A, B) always 
abbreviates {A l ,B l ) x (A 2 ,B 2 ). 

Theorem 18. (A,B) is constant-sum, if and only if both (A 1 ,!? 1 ) and (A 2 ,B 2 ) are 
constant-sum. 

Proof. Assume that (A l ,B l ) and (A 2 ,B 2 ) are constant-sum, that is A\- + Bf- = c k for 
k £ {1, 2} and all Then we have 



2 
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for all ii,i2,ji,j2i so (A, -B) is also a constant-sum game. 

For the other direction, we assume w.l.o.g. that (A , B ) is not constant-sum, so there 
are h, j±, ki, h with A\ lh + B} i h / A\ i h + B\ i h . Then we have: 

A [h,i],\ji,i] + %,i],b'i,i] = A Lh + B Lh + A li + 



Thus, the product (A, B) is not constant-sum. 



□ 



Theorem 19. If (ik,jk) is a pure equilibrium of (A k ,B k ) for k £ {0,1}, if and only if 
([i 1 ,* 2 ], [j , j 2 ]) is a pure equilibrium of (A, B). 

Proof. The proof is done by contraposition. Assume w.l.o.g. that i\ is a better response 
to ji than h, that is AK > A\ h . Then we also have A [ llMAjuh] > AfaMtiuhb so if 
is not a Nash equilibrium, then ([i , i 2 ], [j , j 2 ]) cannot be one either. 
If, on the other hand, [i , i 2 ] is a better response against [j ' ,j 2 ] than [i ,i 2 ], then 
we have Ah . + A 2 . > Ah + A? . . Obviously, this contradicts the conjunction of 

I'jl 12 J2 'liJl '2,J2 



Al , > A\ . and A 2 ,„ > A? . . 



□ 



Theorem 20. If (x k ,y k ) is a Nash equilibrium of (A fc ,i? fc ) for both k £ {0,1}, then 
(x,?/) is a Nash equilibrium of (A,B), where sc[ ili2 ] = x\x\ and y[ mi7712 ] = y^y^. 

Proof. We will prove that x is a best response to y, if rr fc is a best response to y k for 
both k € {0, 1}, the remaining part is analogous. By applying the following equivalence 
transformation 

(nin 2 ) (raim 2 ) 

y %oA ,pyp 

o=l p=l 

ni 712 mi "12 

= S Y Y Y x [oi,o 2 ] A[oi,02],[pi,p2]?/[pi,p2] 
Ol=l 2 = 1 Pl=l P2 = l 

ni ri2 mi "12 

= Z] Y Y Y x o 1 x o 2 (. A o 1 ,pi + A o2,p2)yp\y; 

Ol=l 2 = 1 Pl = lp2 = l 



P2^Plfp2 
1712 



S S x oi A D1 pj y Pl I • r 02 I I S ?/p2 



oi=l pi=l 



+ 



71 2 "12 



, 02 = 1 
"1 



iP2 = l 



S S X °2 A 2,p 2 2/P2 S 



2 =1 P2 = l 



.01=1 



mi 

E y P i 

V P1=1 



ni mi 

S x o 1 A oi pi y Pl 

01 = 1 pi=l 



+ 



712 m2 



Y Y X 02 A 2 ,P2yP2 
02=1 P2 = l 



on both sides of the best response condition 

ni7i2 mim2 ni?i2 mim2 



^ ] ^ ] x oA ,pyp ^ ^ ^ x oA ,pyp 

o=l p=l o=l p=l 
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ri2 


1713 






V 


V 


d/ 02 ^-02 ,P2»P2 




02=1 


P2=l 




> 












1712 




+ 


E 


E 


X C>2 ^o 2 ,P2^P2 




02=1 


P2 = l 





one obtains the form for the best response condition: 



ni mi 

E E x oi^4oi,piypi 
01=1 pi=i 



ni mi 

E E x 0l A 0lpi y Pl 
01=1 pi=i 

As this is just the sum of the best response conditions for the individual games (A 1 , B 2 ) 
and (A 2 ,B 2 ), the claim follows. □ 



Theorem 21. If (x,y) is a Nash equilibrium of (A,B), then (x 1 ,?/ 1 ) given by xj 

n,2 m,2 

Y and Uj = Y U[j.i] is a Nash equilibrium of (A 1 , B 1 ). 



Proof. Again the proof uses contraposition. Assume w.l.o.g. that x 1 is a better response 
against y 1 than x , that is: 



ni mi 



ni mi 



0=1 p=i 0=1 p=i 



n 2 m 2 



Add Y E x o^o,p2/p on both sides, and apply the reverse of the transformation used in 
0=1 p=i 

the proof of Theorem 20. Then one obtains: 



nin2 m\m,2 



n\n2 m\m,2 



y ' y 1 %oA ^pyp > y ^ y ^ x oA Qj pyp 
0=1 p=i 0=1 p=i 

with x defined via x\ 010a ] = x\ x x 2 or This contradicts the assumption that x would be a 
best response against y, so (x, y) cannot be a Nash equilibrium. □ 

Theorem 22. If C k is a correlated equilibrium for (A k , B k ) for both k E {0, 1}, then a 



correlated equilibrium of (A,B) is given by C, defined via C[i 1 .i 2 \\ji,j2\ = ^njiQa 



.12 ' 



Proof. We show the claim only for the condition for the first player, the second player's 
condition is dealt with in the same way. We add the inequalities 



ifc=i ifc=i 
holding for all i^, Ik for both k G {0, 1} to arrive at: 

mi m2 mi 



k 

ikjk 



1112 



31=1 52=1 ji = l j 2 =l 



2 

«2J2 
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n k m k 

Taking into consideration Yl E ^i k j k = ^ ^ or both k G {0, 1}, and summing over all 

»fc=lifc=l 

free variables, this can be expanded to: 




> E E E E [ A hji c iiji c i2ji + \j2 C hh c hh) 

H=l Jl=l 12=1 J2=l 

Application of the definition of C and ^4 yields: 

ni mi n.2 m,2 rei mi ni mi 

Y Y Y Y A [h,i2],Ui,h] c [iiM,\ji,j2] ^YYYY A [hMtiiM C [nM,\ji,m 
*i=i ii=i «2=i ia=i n=i j'i=i *2=i j2=i 

As [ ] is bijective, this is the condition we needed to prove. □ 

Theorem 23. If C is a correlated equilibrium for (A, B), then a correlated equilibrium 

ni mi 

of {A X ,B X ) can be obtained by C} uh = E E C [hM,Hi,h}- 

«2 = 1 J2 = l 

Proof. The result is obtained by reversal of the proof of Theorem 22. □ 

As the product game can be computed from the constituent games, we can use the 
properties of the products of games to obtain the following results regarding the problem 
of finding equilibria: 

Theorem 24. Let Game G {Pure, ZCorr, ZNash, Corr, Nash}. Then 
(GAME nm , GAME W ) < 2 GAME (nfc)i(m() . 

Theorem 25. Let Game g {Pure, ZCorr, ZNash, Corr, Nash}. Then 
(Game)" = 2 Game for all n G N. 

Proof. We prove the claim for n = 2, the remaining part is done by induction. Game <2 
(Game, Game) is trivial. Now observe Game = [~G AME nm ] nimg pj and use the distribu- 
tive law twice, yielding 
(Game, Game) =2 |"(GAME nm , GAME/i^n^^^fj. Application of Theorem 24 concludes 
the proof. □ 

The present paper contains two results interpretable as counterparts to Theorem 24, 
as they allow to reduce finding equilibria for a large game to finding equilibria in several 
smaller games; for mixed strategies, this will be a consequence of the main result pre- 
sented in Subsection 4.3, the corresponding statement for pure strategies is given in the 
next theorem: 

Theorem 26. 1Pure„ +1 < 2 {MLP0 2 ) n . 
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Proof. We describe a Type-2-Machine M with n + 1 input bands containing the relevant 
payoffs, n pairs of two output bands, referred to as ia and ib for i < n. In the ith step of 
the computation, M will write on every output tape. Let wn- be the rational number 
encoded by the ith natural number on the feth input tape. Then, for each k < n, M 
will write 1 on the output tape ka, iff Wq. < Wi^+j + 2~* holds for all j < n + 1 — k, 
and write 1 on the output tape kb, iff Wi^+j < Wn- + 2~* holds for all j < n + 1 — k. 
Considering the definition of p, for no i < n the symbol 1 can be written on both ia and 
ib, so the output of M is in the domain of (MLP0 2 ) n - 

Assume that first M and then {MLP02) n is applied to an (n + l)-matrix game. 
Denote the input with (Pi, P2, P n +i) and the output with w. If there is a k < n, so 
that w(k) = 1 and w(j) = 2 holds for j < k, then p(Pk) > p(Pi) holds for all i < n + 1, 
so k is a valid output. If w(j) = 2 holds for all j < n, then n + 1 is a valid output, as no 
other input value is greater than the n + 1st. □ 

As we have identified MLPO2 (or IP1JRE2) as the basic building stone in the degree of 
discontinuity of finding pure strategies, the following theorem will establish the missing 
link in the relationship between finding pure strategies and multiple robust divisions: 

Theorem 27. MLP0 2 < 2 RDiv. 

Proof. rDiv ^2 MLPO2 has already been proven. For the other direction, note that 
there is a computable (and hence continuous) function turning arbitrary sequences of 
natural numbers into p-names, so that a sequence is mapped to a p-name of iff it is 
N . Thus we can assume that the input of MLPO2 is given as two p-names a, b of real 
numbers, with at least one of them being 0. Consider rDiv(|o|, \a\ + If this is not 
a p-name of 1, then a must be a p-name of 0. If the output is not a p-name of 0, then b 
must be a p-name of 0. □ 

To sum up the results established sofar, we have: 

[(lPURE 2 ) n l„gN =2 1PURE = 2 PURE < 2 [(RDiv)™] neN < 2 ZCORR 

4.3. Problems reducible to [(rDiv) n ] neN 

The goal of this subsection is to present a way of designing reductions to 
[(RDiv) n ] ne N, and, in particular, to present a reduction from Nash. This equivalently 
can be considered as the task to design algorithms for a Type-2-Machine capable of 
making a finite number of independent queries to an oracle for rDiv. Due to Theorems 
26, 27 also oracle calls to MLPO n are permitted. 

We will start by providing a technical lemma similar to Lemma 9. Using the lemma, 
we can prove that the Fourier-Motzkin-algorithm ([20]) for solving systems of linear 
inequalities can be executed using continuous (even computable) operations and oracle 
calls to rDiv. 

Lemma 28. Let F be a multi-valued function defined on a strongly zero- 
dimensional metrisable space X. Then F <2 [(RDiv) n ] ng pj holds, iff there are k closed 
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k 

sets Ai, i < k with X = {J Ai, so that for each i < k, there is a multi- valued function 

i=l 

< 2 [(RDiv) n ] neN with dom(G i ) = X, so that for each g i G G* there is an /' G i 7 
with = 5 f A .. 

Proof. One direction of the proof is trivial. For the other direction, assume that there 
are continuous functions Ri, Qi for each i < k with x h- ► Ri(x,q(Qi(x))) G G* for each 
5 € rDiv. Further let D be the continuous function defined for the sets Aj as in the 
proof to Lemma 9. Define the function Q = (D, Qi, . . . , Qk) and R(x, i, y\, . . . , y^) = 
Ri(x,yi). Both Q and R are continuous, and satisfy x i— ► R(x,q(Q(x))) G F for g G 
(MLPO fc ,([(RDiv) n l neN ) fc ), so we have 

F < 2 (MLPO k , (r(RDiv)"l neN ) fc ) = 2 [(RDiv)™] neN . □ 

Definition 29. The problem BLiNlNEQ nm asks for a p m -name of a vector u of reals, 
so that Av < 6 holds in addition to < v < 1, given a p nm -name for a matrix yl and a 
p"-name for a vector 6, provided that a solution exists. For simplicity, we assume that 
Av < b always contains < v < 1. BLinIneq is the problem without fixed values n, m. 

Theorem 30. BLinIneq < 2 [(rDiv) 2 ] 2€N . 

Proof. As BLinIneq is expressible as a supremum, it suffices to prove 
BLiNlNEQ„ m <2 [(RDiv) 2 ] 2e pj for all n, m G N. For this, we use induction over m. 
The case m = is trivial, so we assume BLiNlNEQ n ( m „ 1 ) <2 [(RDiv) 2 ] ze N. 

For each K C {1, . . . , n}, abbreviate K c := {1, . . . , n} \ K. The set D K = {(A, b) \ 
VfcGFafci >0AV/G K c an < 0} is closed, and the union [J Dk covers the 

KC{l,...,n} 

domain of BLiNlNEQ nm . So due to Lemma 28, it is sufficient to show that BLiNlNEQ nm 
restricted to Dk is reducible to [(RDiv) z ] 2g pj for arbitrary K C {1, . . . , n}. In the next 
step we assume K to be fixed. With the same argument we can assume \ati \ > \a^+i)i\ 
by renumbering the inequalities for each fixed sequence of increasing first coefficients. 

m 

Now we rewrite the given inequalities as a^iv i < bk — ^2 a ki v i f° r k £ K and —bj + 

i=2 

m 

ajiVi < —cijivi for j G K . For each pair k G K, j G K , the corresponding 

i=2 

inequalities can be multiplied by —aj\ respective ojti, and then contracted to: 



aki(-bj + ^] ajiVi) < -aji(b k - y~]akiVi) 



Every solution to the newly created system of linear inequalities can be extended to a 
solution to the original system by choosing a suitable value for v\ . Due to the induction 
assumption, such a solution can be obtained by making oracle calls to [(rDiv) 2 ] 2S n. 
If all afci were known to be non-zero, after solutions for the Vi, i > 2 have been 
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obtained, v% is chosen as a solution to: 



rn 



in 



bj + J2 a ji v i 
i=2 



< v\ < min 

j€KC 



h~J2 a kiVi 
i=2 



max 

k&K 



- ajl 



a kl 



If a certain coefficient a^i is 0, then the corresponding inequality does not restrict the 
value of v\ at all, thus, divisions by should be ignored in the expression above. However, 
since we cannot determine whether a certain coefficient is or not, this approach cannot 
be employed by us. 

Therefore, we evaluate all expressions determining v\ in the order of decreasing ab- 
solute values of the coefficients, that is the expression at\ is considered before a(k+i\i- 
This ensures that all relevant inequalities are met. Thus, to obtain a solution for vx, we 
would like to call 



with opj = min for i G K and op, = max else. As the are ordered as a decreasing 
sequence, values that arise arbitrary as result of a division by zero occur deeper inside 
the nested structure than significant values. While they can influence the actual value 
for v\ that is chosen, it still satisfies all inequalities, if this is possible. However, the 
expression above contains nested calls to rDiv in form of the Vi, 2 < i < n. 

To solve the problem, one replaces v 2 with the corresponding sequence used to compute 
it, then v$, and so on. By moving the max and min operators outside, and unifying all 
divisions, terms of the form rDiv(P, Q) remain, where P is a polynomial in aij, bj whose 
degree does not exceed 2n, and Q is a polynomial in a™ whose degree does not exceed 
n. These can be evaluated by allowed oracle calls, and the max and min operators are 
continuous. □ 

As the problem BLinIneq is of considerable interest on its own, we shall note that 
the converse statement to Theorem 30 is also true: 

Theorem 31. |~(R,Div) z ] zg N <2 BLinIneq. 

Proof. We have to show (rDiv)™ <2 BLinIneq for each n G N. Given n pairs of reals 
(pi,qi), consider the system of linear equalities given by An = qi, Aij = for i ^ j and 
hi = pi. The only solution is given by v i = —. By replacing every equality with two 
inequalities, the needed reduction is found. □ 

By adapting [21, Algorithm 3.4] and applying Lemma 28 and Theorem 30 we proceed 
to prove the main theorem of this subsection. Again, the reasoning directly extends to 
more than two players. 



m m 



v\ = max 



(0,min(l,op 1 (RDiv(|6i -^Jau^l, |on|), op 2 (|RDiv(6 2 -} j a2iVj\, |«2i|),-- • 




Theorem 32. Nash < 2 [(rDiv) z ] 2( = n . 
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Proof. By the same reasoning as above, since Nash is the supremum 
[NASH nm ] njme N, it suffices to show NASH nm < 2 |~(RDiv) z ] ze N for arbitrary n,m G N. 

By the best response condition ([21, Proposition 3.1]), a pair of mixed strategies (x, y) 
is a Nash equilibrium of a game if each pure strategy played with positive probability in 
x (in y) is a best response against y (against x). This condition can be formalized by 
noting that the following set is the set of games and their Nash equilibria with support 
in /, J: 

A = {(A,B,x,y)\j,keJl£J (x T B)j = (x T B) k > {x T B) l Vl = i,p G I 
IJ ~ q£l {Ay), = (Ay) p > (Ay) q x q = 0} 

The set Gi,j is closed, and so is its projection Gi ; j = {(A, B) \ 3x, y (A, B, x, y) G 

As every game has a Nash equilibrium, the sets Gj j cover the domain of Nash, so we 
can apply Lemma 28. To recover the Nash equilibrium (x, y) from /, J the corresponding 
system of linear inequalities has to be solved, which is reducible to [(RDiv) z ] ze N as 
established in Theorem 30. □ 

Corollary 33. ZCorr = 2 Corr = 2 ZNash = 2 Nash = 2 [~(RDiv) n ]„ eN . 

The same technique applied in the proof of Theorem 30 can also be used to show that 
Gaussian Elimination can be reduced to [~(RDrv) n ] ne psj. This shows that the reduction 
of Gaussian Elimination to the rank of a matrix given in [22] is strict, taking into 
consideration Corollary 39. 



5. Additional Results 
5.1. Nash and Sep 

To shed further light on the degree of discontinuity of Nash, we will compare it to the 
problem Sep studied in [23] . 

Definition 34. / € Sep holds, iff / is a function from 

{(p, q) G N N x N N | Vn, m G N p{n) + q{m)} 

to N N satisfying f(p(n)) = and f(q(n)) = 1 for all n G N. 

The problem Sep was shown to be equivalent to finding an infinite path in an infinite 
binary tree and extending a linear functional from a subspace of a Banach space to the 
complete space following the Hahn-Banach Theorem. Sep can be reduced to {Ci}, which 
is defined through C\(p){n) = 1, iff there is an i G N with p(i) = n and C\{jp){n) = 
else. The function C\ has been introduced in [15]. In [24, Theorem 5.5], it was proven 
that a function is ^2" measura ble, iff it is reducible to C\. 

In [23], {c/} ^ 2 Sep was shown, which can directly to extended to prove {/} ^ 2 Sep 
for all discontinuous functions /. In the following, we will prove that Nash is strictly 
reducible to Sep, thereby obtaining a lower bound for Sep. For this aim, we need the 
level of Sep. 
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Theorem 35. Lev 2 (Sep) does not exist. 

Proof. We have to prove that for every / € Sep, Lev 2 (/) does not exist. For notation, 
we define R p = {p(n) \ n £ N}. We study the points (p, q) where / might be continuous. 
First we assume there exists an n G N \ (R p U R q ). Define pk through pk(i) = p(i) for 
i ^ k and Pk(k) = n, and g& through qk(i) = q(i) for i ^ k and qk(k) = n. Then 
lim (p k ,q) = lim (p,q k ) = (p,q) holds. However, f(pk,q)(n) = and f(p,qk)(n) = 1, 

k— >oo fc— >oo 

so / cannot be continuous in (p,q). Whether / is continuous in a point (p, q) with 
R p U R q = N depends on /. 

Rephrasing the considerations above, we know cl{(p, q) \ R q U R p ^ N, R q H Rp = 0} C 
C\(f). However, for each (p, q) with R p UR q = N, define pk through p k (i) = p{i) for i < k, 
and Pk(i) = p(k) for i > k, analogously define q k through qk(i) = q(i) for i < k, and 
Qk{i) — q{k) for i > k. Then lim (pk, qk) = (p, q), and for each k, R Pk UR qk is even finite. 

k— *oo 

Thus, C\(f) = £o(/) follows. Transfinite induction easily proves C^if) = ^o(f ) 7^ f° r 
all ordinal numbers a. □ 

Due to the behaviour of the level under formation of products ([17]) and suprema 
([9], [16]), we know Lev 2 (Nash) = u>, where lo is the smallest infinite ordinal. This is 
sufficient to establish Sep ^2 Nash by [9, Theorem 5.7]. 

Theorem 36. rDiv < 2 Sep. 

Proof. [To Theorem 36] Let (a, b) be the input for rDiv. We describe a machine trans- 
forming it to an input for Sep. The machine has two different modes, starting in the 
first one. In each stage i, write 1 on the first and 2 on the second output tape. Then 
test v{bi) > 2~ l+l . If yes, change to mode 2, otherwise continue with stage i + 1. 

In the following description of the second mode, let io denote the stage of the first 
mode during which the switch occurred. We will use the following inequality: 

v{ai) _ p{a) 
v(h) p(b) 

The stages in the second mode are indexed by (employing a monotone bijective 
pairing [ ] : N x N -> N). In each stage, test |4rr ~ U U)\ < 2 " i ~ 1 with k = i + 2i + 3. 
If the answer is yes, write 2 + on the second output tape, otherwise write 2 + 
on the first tape. Note that yes also implies |4jf — v(j)\ < 2*. 

It remains to describe a second Type-2-Machine which recovers a p-name for ^ from 
the result w of the applying of Sep to the output of the machine described above. For 
that, we fix a function k : N — > N with the following property: 

\/i Vfc 3j < \v{k) - u(j)\ < l' 1 ' 1 

If the numbering v is chosen in a way that no computable k exists, k is assumed to be 
given by an oracle, this still allows a continuous reduction. 



< 2 _[i-2(io+l)] 
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In the stage i of our second machine, test u>2+[jj] = 1? for each j from 1 to n(i). If a 
j is found which yields yes, then write j on the output tape and proceed with the next 
stage. If the answer is always NO, repeat the last output forever (always write 1 if there 
has been no output yet). 

If p(b) ^ 0, then the first machine will eventually switch to the second mode. There, 
all 2 _i -approximations u(j) for ^j|y are computed. Due to the properties of k, at least 
one of them fulfills j < k(i), and is found and printed by the second machine. If p(b) = 0, 
then the second machine is still guaranteed to produce a valid p-name. 

□ 

Theorem 37. (Sep, Sep) =2 Sep. 

Proof. One direction is trivial. For the other, define the continuous function G : 
N N x N N — > N N via G(p, q)(2k) = 2p{k) and G(p, q)(2k+l) =2q(k)+l. Define the contin- 
uous function F : N N — > N N xN N through F(p) = (qi, q 2 ), where qi(i) = p(2i) and g 2 (*) = 
p(2i + 1). Now observe 

(Sep,Sep)(p 1 ,q 1 ,p 2 ,q2) = F(Sep(G(p 1 ,p 2 ),G(q 1 ,q 2 ))). □ 

Corollary 38. Nash < 2 Sep. 

Proof. Due to Theorem 32 and the properties of suprema, we just have to show (rDiv)™ <2 
Sep for all n G N. Theorem 36 yields (rDiv)™ <2 {Sep) n , repeated application of The- 
orem 37 yields (Sep) n =2 Sep. □ 

Corollary 39. {/} ^2 Nash for all discontinuous functions /. 
5.2. The Level of Nash 2 2 

The simplest non-trivial bi-matrix games, 2x2 games, have already been investigated 
from a constructive point of view in [25]. Among other results, [25] contains the con- 
structive analogue to the reduction MLPO2 <2 NASH22, and the constructive analogue 
to determine a subset of £o(NASti22) \ £i(NASH22), that is the set where Nash equilib- 
ria are continuous. We will produce the TTE-counterpart by investigating the Level of 
Nash 22 . 

Theorem 40. Lev(NASH 2 2) = 4. 

Proof. [To Theorem 40] A strategy in this setting can be describe by merely a single 
real number, the probability of the first pure strategy to be chosen. This allows to 
condense the information given in the game: Row-player tries to maximize x(c+dy) and 
column-player tries to maximize y(e + fy) with c = an — a±2 — Q>i\ + a>22, d = a\2 — 0,22, 
e = bn — b±2 — &21 + &22 arid / = 621 — °22- The table in the Appendix defines a 
function in NASH22 depending on these value which obviously has Level 4, establishing 
Lev(NASH22) < 4. It is straight-forward to check that all points of discontinuity of this 
function are points of discontinuity of every choice function for NASH22. □ 
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